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lationships  between  the  costs  of  current  and  past  weapon  systems 
to  system  physical,  performance,  and  technical  parameters.  These 
CERs  can  be  used  to  predict  the  costs  of  future  weapons  systems. 
CERs  are  often  regression  equations  that  are  nonlinear  in  the 
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FOREWORD 


The  Naval  Weapons  Center  Weapon  Systems  Cost  Analysis  Division 
develops  Cost  Estimating  Relationships  (CERs)  to  estimate  the  relation¬ 
ships  between  the  costs  of  current  and  past  weapon  systems  to  system 
physical,  performance,  and  technical  parameters.  These  CERs  can  be  used 
to  predict  the  costs  of  future  weapons  systems.  CERs  are  often  regres¬ 
sion  equations  that  are  nonlinear  in  the  parameters. 

This  report  presents  programs  in  the  FORTRAN  V  and  BASIC  computer 
languages  employing  a  statistical  technique  to  estimate  the  parameters 
for  nonlinear  regression  equations .  These  computer  programs  could  be 
modified  or  expanded  in  the  future  to  utilize  an  improved  statistical 
technique  or  to  include  additional  statistical  calculations  and  output 
that  would  provide  information  to  the  user. 

The  study  reported  herein  was  conducted  from  October  197^+  to  June 
1975.  The  computer  programs  were  revised  in  March  1976  to  present 
additional  output  information. 

This  is  an  informal  report  of  the  Naval  Weapons  Center  and  is 
not  to  be  used  as  authority  for  action. 


Floyd  W.  Erickson 

Weapon  Systems  Cost  Analysis  Division 
Office  of  Finance  and  Management 
30  March  1976 
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1.0  THEORY 

The  purpose  of  this  study  was  to  develop  programs,  in  the  FORTRAN 
V  and  BASIC  computer  languages,  employing  a  statistical  technique  to 
estimate  the  parameters  for  nonlinear  regression  equations. 


The  model 


Y  -  0o  +  0iXj  +  02X2  +  * 


+  0  X  +  e 
P  P 


where  Y  ■  Dependent  variable 

0^  *  Regression  parameter 
X^  *  Independent  variable 
e  *  Error  term 

is  linear  in  the  parameters.  This  model  can  be  fitted  using  the  linear 
least  squares  technique.  Any  model  which  is  not  of  the  above  form  is  a 
nonlinear  model,  that  is,  nonlinear  in  the  parameters.  The  following 
are  some  examples  of  nonlinear  models. 

1)  Y  =  e0X  +  e 

This  model  has  an  additive  error  term.  It  can  be  made  linear  by 

the  transformation  of  the  parameter.  If  we  transform  B  =  e0,  the  model 

becomes  Y  =  BX  +  e.  The  model  Y  =  e0  +  £  is  intrinsically  linear  since 
it  can  be  transformed  into  a  linear  form. 

2)  Y  =  exp (0i  +  02X  +  e) 

This  model  can  be  transformed  into  the  linear  model 
In  Y  -  0i  +  02X  +  e 

It  is  intrinsically  linear.  The  error  term  in  the  transformed  model 
is  additive. 

3)  Y  -  0i  Xi02  X203  +  e 
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This  model  is  intrinsically  nonlinear.  It  is  not  possible  to  con¬ 
vert  it  into  a  linear  model.  A  In  transformation  cannot  be  made  because 
the  error  term  is  additive.  Linear  least  squares  techniques  cannot  be 
used  to  estimate  the  parameters. 

A)  Y  -  Qi  Xi02  X2°3  e 

The  error  term  here  is  multiplicative.  This  model  can  be  trans¬ 
formed  into  the  linear  model 

In  Y  »  In  0i  +  02  In  X2  +  In  e 

It  is  intrinsically  linear.  However,  fitting  this  transformed  model 
by  linear  least  squares  techniques  will  result  in  estimated  parameters 
that  minimize  the  sum  of  the  squared  deviations  of  In  e  from  the 
regression  line. 

Examples  3  and  A  point  out  the  common  error  of  ignoring  the  form 
of  the  error  term  in  a  nonlinear  model.  For  example,  the  model 

Y  «  0i  Xi°2  X2°3 
would  be  transformed  to 

In  Y  =  In  0i  +  02  In  Xi  +  03  In  X2 

This  transformed  model  would  be  fitted  by  standard  least  squares  tech¬ 
niques,  and  it  would  be  assumed  that  the  sum  of  the  squared  deviations 
of  „e  from  the  regression  line  would  be  minimized.  As  shown  in  Example 
3,  if  the  error  term  were  additive,  the  In  transformation  could  not  be 
made.  As  shown  in  Example  A,  if  the  error  term  were  multiplicative, 
the  model  would  be  fitted  using  In  e  as  the  error  term. 

Cost  estimating  relationships  are  often  of  the  form 

Y  =  0i  Xi°2  +  e 

Thus  it  would  be  of  value  to  have  a  valid  statistical  technique  to 
estimate  the  parameters  of  this  intrinsically  nonlinear  model. 

One  method  of  fitting  the  parameters  in  a  nonlinear  regression 
equation  is  the  iterative  modified  Gauss-Newton  least  squares  method1. 
Consider  the  following  nonlinear  problem:  Given  n  sets  of  observations 


'h.  0.  Hartley.  "The  Modified  Causs-Newton  Method  for  the  Fitting  of 
Nonlinear  Regression  Functions  by  Least  Squares",  Technometrics, 

Vol.  3  (1961),  pp.  269-80. 
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each  with  one  dependent  variable  Y^,  and  1  independent  variables, 

Xhl’  Xh2*  *  *  ’  ^Sil’  ^  =  1»2*  *  '  '  n)»  an<*  the  nonlinear 
function 

f  (X,0)  =  f  (Xi,  X2,  *  •  •  X,  ;  0j,  02>*  *  ‘  0) 

m 

it  is  required  to  determine  a  set  of  0^  for  which  the  error  sums  of 
squares 

n 

Q  (0)  *  Z  (Y,  -  f  (X.  ,  0))2  =  Minimum 
h-1  h  ^ 

The  symbol  X^  stands  for  the  h-vector  with  elements  X^,  X^.*  *  * 
X^  and  the  symbol  0  for  the  m-vector  with  elements  0j,  02,*  '  *  0^. 

The  Modified  Gauss-Newton  method  uses  the  results  of  linear  least 
squares  in  a  succession  of  stages.  Suppose  the  postulated  model  is  of 
the  form 

Yh  ■ f  <v 0)  +  s 

Let  o©i t  002 »’  '  *  o©  be  the  initial  values  of  the  parameters  0j,  02, 

m 

•  *  *  0^.  These  initial  values  may  be  intelligent  guesses  or  prelimi¬ 
nary  estimates  based  on  whatever  information  is  available.  If  we  carry 
out  a  first-order  Taylor's  expansion  of  f  (X^,  0)  at  0  =  o®. 

m  3f  (X,  ,  0) 

#•  /  ••  a\  e  /<•  a\  .  n  I*  /  A  A  \ 


f  0^,  S)  -  f  0^,  00)  + 


(61  -  »v 


where  the  derivative  of  f(X^,  ®)  is  evaluated  at  0  =  g0. 

This  linear  approximation  to  the  nonlinear  function  can  be  substituted 
into  the  error  sums  of  squares,  Q(0),  equation 

n  m3  f  (X.  ,  0) 

Q(0)  =  Z  {Y.  -  f  (X.  ,  o0)  -  r  - - -  (0.  -  00  -  Minimum 

.  h-l  h  11  J-l  9  8j  J  3 

where  the  derivative  of  f(X.  ,  0)  is  evaluated  at  0  =  q0. 

n 

The  value  of  the  vector  0  that  minimizes  Q(0)  is  obtained  from  the 
solution  of  the  following  set  of  linear  equations. 


n  i 


5 


3Q(0) 

30, 
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n  m  3f  (X,  ,  0) 

-2  Z  {Y.  -  f(X.  ,  o0)  -  Z  - 5K -  (0,  -  00,))  • 

h-1  h  ^  j-1  30j  J  J 


3f(X.,  0) 

301  U 

where  the  derivative  of  f(X^,  0)  is  evaluated  at  0  =  o0* 


Z  {Yh  "  f(Xh’  °0)}  fi(Xh’  °0)  “  1  {  1  fi(Xh’  °0)  fj(Xh’  °0)}  °j 

3f(X  ,  0) 

where  f^X^,  o0)  =  - -  evaluated  at  0  =  o0 

and  Dj  =  (Oj  -  oOj) 

These  normal  equations  can  be  solved  for  D  ^ . 

Me  replace  o0  by  00  +  hD  and  evaluate  Q(o0  +  *SD) .  If  Q(o&  +  %D)  is 
less  than  Q(o0)»  00  +  is  taken  as  the  new  estimate  of  the  vector  0. 

Consider  the  function 

Q(v)  =  Q(o0  +  vD)  for  0  £  v  <_  1 

and  denote  by  v'  the  value  for  v  for  which  Q(v)  is  a  minimum  on  the 
interval  0  £  v  £  1.  We  approximate  v’  by  evaluating  v  =  0,  \  and  1 
and  solving 

Vmin  =  %  +  WQ(°)  -  QO)>  /  (QO)  ~  2Q(*s)  +  Q(0) } 

If  Q(o0  +  ^sD)  is  not  less  than  Q(o0)»  o©  +  vm^nD  is  taken  as  the  new 
estimate  of  the  vector  0. 

The  iteration  is  continued  until  the  maximum  fractional  change 
in  the  parameter  estimates  is  less  than  or  equal  to  a  specified  toler¬ 
ance  level,  or  the  desired  number  of  iterations  is  completed. 

The  above  method  is  utilized  in  a  FORTRAN  V  language  program  for 
the  UNIVAC  1110  computer  and  a  BASIC  language  program  for  the  Hewlett- 
Packard  9830A  calculator.  The  following  nonlinear  equations  have  been 
incorporated  into  these  programs. 


6 


Equation  1) 
Equation  2) 
Equation  3) 
Equation  4) 
Equation  5) 


Y 

Y 

Y 

Y 

Y 


r,  ©2*  ^ 

01  e  '  +  e 
0i  X02  +  e 
0i  Xi02  x203  +  e 
0i  Xi02  X203  x301*  +  e 


0i  Xi02  +  03  x2°4  +  e 


04 


The  parameters  for  two  additional  equations,  each  with  a  maximum  of 
seven  independent  variables  and  seven  parameters,  can  be  estimated  as 
needed  by  the  user. 

The  programs  are  designed  to  stop  iteration  when  the  maximum 
fractional  change  in  the  parameter  estimates  is  less  than  or  equal  to 
a  tolerance  input,  or  the  number  of  iterations  equals  15. 
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2.2  INPUTS 


Card 

Input 

Card  Column 

Format* 

1 

NPRINT 

1  -  5 

I 

5 

2 

NDATA 

1  -  5 

I 

5 

3 

NOBS 

1  -  5 

I 

5 

NX 

6-10 

I 

5 

TOLER 

11  -  15 

F 

5.0 

4 

X  (1  ,  1  ) 

1  -  10 

F 

10.0 

X  (1  ,  2  ) 

• 

11  -  20 

F 

• 

10.0 

• 

X  (1  ,  J) 

maximum  of  7  independent  variables 

• 

• 

F 

10.0 

Y  (  1) 

immediately  following  last  X 

(1,J) 

F 

10.0 

5 

X  (2  ,  1  ) 

• 

1  -  10 

F 

• 

10.0 

• 

X  (2  ,  J) 

• 

• 

F 

10.0 

Y  (2) 

F 

10.0 

Continue 

to  place  one  observation  per  card,  up  to 

30  observations. 

Following  the  input  i 

of  observations  for  each  data 

set, 

three  cards  are 

used  for 

the  specifications  of  each  equation  for  which 

the  parameters 

are  to  be 

estimated , 

1 

NEQUAT 

1  -  5 

I 

5 

2 

NNX  (1) 

• 

1  -  5 

I 

• 

5 

• 

• 

NNX  (7) 

31  -  35 

• 

• 

-  I 

5 

List  in  any  order  on  Card  2  the  independent  variable  number(s)  to  be 
used,  up  to  a  maximum  of  7  variables. 

*A11  inputs  using  the  I  format  are  integers  that  must  be  right-justif ied 
in  their  respective  fields.  All  inputs  using  the  F  format  are  floating 
point  numbers  that  must  be  right- justified  in  their  respective  fields 
unless  a  decimal  point  is  included  in  the  field. 
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Card 

Input 

Card  Column 

Format 

3 

THETA 

• 

(1) 

1  -  10 

F  10.0 

• 

• 

• 

THETA 

00 

• 

• 

F  10.0 

List 

each 

on  Card  3, 
parameter. 

in  the  order 

<v 

corresponding  to  Card  2, 

the  estimate  i 

These  three  cards  will  be  repeated  for  each  equation.  When  these 
cards  have  been  placed  for  all  desired  equations  for  the  data  set, 
place  a  card  with  0  in  card  column  5.  If  NDATA  is  greater  than  1, 
following  the  0  card  place  in  the  following  order:  a  card  with  NOBS, 

NX,  and  TOLER;  the  cards  with  X(I,  1  ),  •  •  •  X  (I,  J),  Y  (I);  and  three 
cards  for  each  equation  to  be  fitted  for  that  data  set.  Repeat  for 
the  remaining  data  sets. 

Input  definitions: 

-  Set  =  0  for  print-out  of  final  iteration  only. 

-  Set  =  1  for  full  print-out. 

-  Number  of  sets  of  data. 

-  Number  of  observations  in  data  set. 

-  Number  of  independent  variables  for  each  observation. 

-  Tolerance  input.  When  the  maximum  fractional  change 
in  the  parameter  estimates  is  less  than  or  equal  to 
this  tolerance,  the  iterative  procedure  will  stop  and 
the  program  will  continue  to  the  next  equation. 

-  Value  of  the  independent  variable  for  the 
observation. 

-  Value  of  the  dependent  variable  for  the  I1"*1  observation. 

-  Number  of  the  equation  to  be  fitted. 

•  •  NNX(7) 

-  The  independent  variable  numbers,  to  be  used  in  the 
chosen  equation,  in  order  of  use. 

-  The  initial  estimates  of  the  parameters  for  the  chosen 
equation. 

Two  additional  equations  can  be  inserted  into  the  SUBROUTINE  FUNCT. 
To  fit  these  equations  set  the  equation  number  equal  to  6  or  7  and 
insert  a  card  with  NTHETA  in  Columns  1-5  under  I  5  format  immediately 
following  the  card  declaring  the  value  of  NEQUAT  and  preceding  the 
card  declaring  NNX  (1),  •  •  •  NNX  (7).  If  the  equation  number  equals  6, 
Insert  the  equation  followed  by  its  derivatives  with  respect  to  0i ,  Qj , 

•  •  •  immediately  following  statement  106  in  SUBROUTINE  FUNCT.  If 


NPRINT 

NDATA 

NOBS 

NX 

TOLER 


X(I,J) 

Y  (I) 
NEQUAT 
NNX ( 1 ) ,  • 


THETA (K) 
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the  equation  number  equals  7,  insert  the  equation  followed  by  its 

derivatives  with  respect  to  0j,  02,  •  •  *0  immediately  following 

m 

statement  107  in  SUBROUTINE  FUNCT.  The  expressions  for  the  equation  and 
its  derivatives  must  be  in  FORTRAN  V  computer  language.  The  following 
names  should  be  applied  as  needed. 

The  dependent  variable  for  the  observation  esti¬ 
mated  from  the  equation, 
til 

The  K  parameter,  0^. 

The  independent  variable  for  the  I^1  observation. 

The  derivative  of  the  equation  with  respect  to  0, 

t  h  ^ 

evaluated  for  the  I  observation. 


FZ  (I) 

THETA  (K)  - 

X(I,J) 

DFZ  (I,K)  - 
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l 
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This  data  was  collected  from  several  sources.  The  regression  equation  is  presented  in  the  following  document 
Naval  Weapons  Center.  An  Independent  Cost  Analysis  of  the  HARM  Weapon  System  RDT&E  (U) ,  by  Douglas 
R.  Johnson,  Dr.  Barbara  J.  Bell,  Robert  E.  Sax,  Paul  A.  Douillard  and  W.  Eugene  Waller.  China  Lake,  Calif., 
NUC,  October  1975,  p.  38.  (Publication  CONFIDENTIAL.) 
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Data  Source: 

Naval  Weapons  Center.  Solid  Motor  Cost  and  Reliability  Prediction  Methodology,  Final  Technical  Report  (U) 
by  Booz-Allen  Applied  Research.  China  Lake,  Calif.,  NWC,  March  1974.  Tables  5  and  6.  (NWC  TP  5634, 
Publication  CONFIDENTIAL.) 
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3.0  HEWLETT-PACKARD  9830A  CALCULATOR  PRESENTATION 
3.1  PROGRAM  * 


10  PEN  DR.  BRRERRR  I.  BELL'  NONLINEAR 
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*  The  core  required  by  the  main  and  KEY  proprams  Is  3801  words  (16  bits- 
2  bytes  per  word).  The  additional  core  required  to  execute  the  program 
varies  with  the  number  of  observations  and  the  number  of  independent 
variables  fitted.  For  example,  the  additional  core  required  to  execute 
Data  Set  1  is  1933  words  and  for  Data  Set  2  is  1S51  words. 
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ME  INDEPENDENT  VARIABLES)  FITTED  =  ' 
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£450  IT  K 1  ]=TC  K 1  3+  ( 8 .  5-T3 >  *E[  K 1  3 

£460  NEXT  K 1 
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» J2  37 

TC 

£290 

DC  I  j  4 3—TC  1 

3* XC  I 

i>  J 1 

37  T 

C  £  39 

XC  I 

?  J2  37 

TC 

2300 

NEXT  I 

23 1 0 

GOTO  2450 

2320 

IF  H4 >5  TH 

EN  24 

10 

2330 

FOR  1=1  TO 

HI 

2340 

FC  1  3—TC  1  3* 

XC  I  j  J 

1  37 

TC  2 

3+TC 

3  39 

XC  I  -  J 

2  3 

2350 

DC  I  ?  1  3=XC  I 

j  Jl  37 

TC  2 

3 

£360 

DC  I  ?  2  3=TC  1 

3  ■  XL  I 

j  Jl 

37  T 

C  2  3  9 

LOG 

XC  1  j  J 

1  3 

2  8  r'  0 

DC  I  ? 3 3=xr  1 

5  J2  37 

TC  4 

3 

£380 

DCI  j  4  3=TC  3 

3  9  X  C  I 

’  J2 

37  T 

['  4  39 

LOG, 

XC  I ,  J 

2  3 

2390 

NEXT  I 

2400 

GOTO  2450 

2410 

IF  N4 >6  TH 

El!  24 

4y 

2420 

REN  i  fiD'D  E 

O'  i,97  I 

jN 

<N4 

n  |;  J,  ) 

HER 

E 

2430 

GOTO  2450 

2440 

REM:  ODD  E 

OUFiT  I 

3H 

(N4 

7 

HER! 

E 

2450 

RETURN  0 

2460 

END 

XC  I  j 
XL  i  i 


Ji 

J'd 


]> 

J) 


3  ] 

3  3 
j  h:> 


j  > 
[  i 


E  I J  J 


]tT[ 
[  4  ] 

3  37 
3  3* 
IT 


4  3 

71 
T[ 
7  [ 


'!•  3* 


3* 


LO 


3GXC  I  ■ 
4 3*LOGXC  ’  ? 


LOG 
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•600  DEF  F  HR  <  P ::  "> 

1010  FOR  1  =  1  TO  N3 
1020  FOR  -.1=1  TO  N7 
030  LC  I ?  J  3=flBE<fl[  I »  J]> 

1640  NEXT  J 
1050  NEXT  T 
060  k:  1=1= j=i 

1070  LI  =2 

1080  IF  LCI»J3  >=  LC  .<1  j  LI  3  THEN  3110 
090  I=K1 
100  J=L 1 

ill©  IF  N< L.  1  THEN  3158 
.120  IF  H>L  1  THEN  32  30 
130  IF  N=K1  THEN  3220 
140  IF  M>K1  Tf.EN  3170 
150  PRINT  "N  =■■ " N " N  <  L  OR  K" 

160  GOTO  3560 
170  Kl-Kl+1 
180  L.  1  =  1 
190  GOTO  3030 
£00  L1=L1+1 

219  GOTO  3080 

220  K2= I 

239  L2= J 

240  FOR  1=1  TC  M3 
250  FOR  J=1  TO  M7 
260  ME  I  ?  J  ]=flC  1 1*  J  1 
270  NEXT  J 

£88  NEXT  I 
290  FOR  ,J=1  TO  N7 
30O  .flC 1 j  J ]=MC  K2i J  I 
310  flC  K£  j  J  ]=Hl  1 >  J  3 
320  NEXT  J 
330  FOR  1=1  TC  N3 
346  FOR  J=1  TO  N7 
358  hC  I  ? ...»  ]=RC  I  i  J  I 
360  NEXT  ,1 
370  NEXT  I 
380  FOR  1=1  T£  N3 
390  RC  I  ?  1  ]=N[  i  L2  3 
480  RC  1 1 12  ]=Mt  I 1  3 
410  NEXT  I 
420  13=1+11 
430  1 2=K£+ 1 1 
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KEY  f3 


5000  DEF  FNP(Pl) 

5010  FOR  [=1  TO  N3 
5620  FOR  J=1  TO  H? 

5030  IJt  I  j  J  ]=RC  1 »  J  3 
5840  NEXT  J 
5050  NEXT  I 
5060  FOR  1=1  TO  N3 

5070  intern 

5086  FOR  ,1=1  TO  N7 
5090  AC  M 1  <  J  3=UC  I*  J] 

5100  NEXT  J 
5110  NEXT  I 
5120  FOR  1=1  TO  N3 
5130  FOR  0=1  TO  H7 
5140  UC I ? J  3=flC J  j  J  ] 

5156  NEXT  J 
5160  NEXT  I 
5170  FOR  J=1  TO  N3 
5180  M2=i<CJ] 

5190  FOR  1=1  TO  H3 
5200  HE  I  j  M2+ 1  MJE  I  j  J  ■'  1  ] 
5210  NEXT  I 
5220  NEXT  J 
5230  RETURN  O 
52T40  END 


NWC  TM  2786 


3.2  INPUTS 


1.  Insert  cassette. 

2.  Key  in:  LOAD  (N),  where  N  =  file  number  of  main  program. 

3.  EXECUTE 

4.  Key  in:  LOAD  KEY  (M) ,  where\.M  =  file  number  of  KEY  programs. 

5.  EXECUTE 

6.  RUN 

7.  EXECUTE 

8.  "FULL  PRINT?  1  =  YES,  0  =  NO"  will  be  displayed. 

9.  Key  in:  0  for  print-out  of  final  iteration  only. 

1  for  full  print-out. 

10.  EXECUTE 

11.  "ENTER  NO.  OF  OBSERVATIONS"  will  be  displayed. 

12.  Key  in:  Number  of  observations  to  be  inputted. 

13.  EXECUTE 

14.  "ENTER  NO.  OF  IND.  VAR.  (X'S)"  will  be  displayed. 

15.  Key  in:  Number  of  independent  variables  to  be  inputted. 

16.  EXECUTE 

17.  "ENTER  TOLERANCE  (.01)"  will  be  displayed. 

18.  Key  in:  Tolerance  input.  When  the  maximum  fractional  change  in 

the  parameter  estimate (s)  is  less  than  or  equal  to  this 
tolerance,  the  iterative  procedure  will  stop  and  the 
program  will  continue  to  the  next  equation. 

19.  EXECUTE 

20.  "INPUT  Y (I) "  will  be  displayed.  th 

21.  Key  in:  Value  of  the  dependent  variable  for  the  I  observation. 

22.  EXECUTE 

23.  "INPUT  X(I,  J)"  will  be  displayed. 

24.  Key  in:  Value  of  the  J^independent  variable  for  the  1^ 

observation. 

25.  EXECUTE  th 

Steps  23  -  25  will  be  repeated  for  all  X  variables  for  the  I 
observation. 

26.  Steps  20  -  25  will  be  repeated  for  all  observations. 

27.  "EQUATION  NO."  will  be  displayed. 

28.  Key  in:  Number  of  the  equation  to  be  fitted. 

29.  EXECUTE 

30.  "ENTER  J  FOR  FIRST  X(I,  J)"  will  be  displayed. 

31.  Key  in:  The  first  independent  variable  number  to  be  used  in 

the  chosen  equation. 

32.  EXECUTE 

33.  For  equations  1-4  steps  30  -  32  will  be  repeated  up  to  the 
number  of  independent  variable (s)  used  in  the  chosen  equation. 

For  equation  5  enter  in  order  the  numbers  of  the  two  independent 
variables  to  be  used.  When  the  number  of  a  third  independent 
variable  is  requested,  enter  0.  (Only  two  independent  variables 
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are  required  for  equation  5.  The  input  of  0  as  the  third  inde¬ 
pendent  variable  is  for  the  purpose  of  saving  calculator  storage 
space.)  If  user  equations  are  to  be  fitted,  steps  30  -  32  will 
be  repeated  to  allow  the  user  to  indicate  up  to  7  independent 
variables.  When  the  ordered  list  of  the  independent  variable 
numbers  is  completed,  enter  0  when  step  30  is  displayed. 

34.  "ENTER  THETA  ESTIMATE  K"  will  be  displayed. 

35.  Key  in:  The  initial  estimate  of  the  K1^  parameter,  0.  . 

36.  EXECUTE  R 

37.  For  equations  1-5  steps  34  -  36  will  be  repeated  up  to  the  number 
of  parameters  for  the  chosen  equation.  If  user  equations  are  to 
be  fitted,  steps  34  -  36  will  be  repeated  to  allow  the  user  to 
input  up  to  7  parameter  estimates.  When  the  ordered  list  of  para¬ 
meter  estimates  is  completed,  enter  0  each  time  step  34  is  dis¬ 
played. 

38.  An  equation  is  fitted  until  the  tolerance  level  is  reached  or  until 
15  iterations  have  been  completed. 

39.  "ANOTHER  EQUATION?  0  =  NO,  1  =  YES"  will  be  displayed. 

40.  Key  in:  0  or  1  as  indicated.  If  1  is  keyed  in,  the  program  will 

return  to  step  27.  .  _ 

41.  When  all  desired  equations  have  been  estimated  for  the  data  set, 
another  data  set  can  be  entered  by  pressing  the  RUN,  EXECUTE  keys. 

Two  additional  equations  can  be  inserted  into  the  first  KEY  pro¬ 
gram  (KEY  f q) .  To  fit  these  equations  set  the  equation  number  equal 

to  6  or  7  at  step  28.  Before  step  30  "ENTER  NO.  OF  THETAS"  will  be 

displayed.  Key  in:  The  number  of  parameters,  0's,  in  the  equation 

to  be  inserted.  Press  EXECUTE.  Continue  at  step  30.  If  equation 

number  equals  6,  insert  the  equation  followed  by  its  derivatives  with 

respect  to  0j,  02,  *  *  *  0  immediately  following  statement  2420  in 

m 

KEY  fQ.  If  equation  number  equals  7,  insert  the  equation  followed  by 

its  derivatives  with  respect  to  0j,  02,  •  •  •  0  immediately  following 

statement  2440  in  KEY  fQ.  The  expressions  for  the  equation  and  its 

derivatives  must  be  in  BASIC  computer  language.  The  following  names 
should  be  applied  as  needed. 

F(I)  -  The  dependent  variable  for  the  I1*1  observation 

estimated  from  the  equation. 

T(K)  -  The  K  parameter,  0,  . 

tR  ^  tR 

X(I,J)  -  The  Jc  independent  variable  for  the  I  observation. 

D(1,K)  -  Derivative  of  the  equation  with  respect  to  0^  evalu¬ 

ated  for  the  Ith  observation. 
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DATA  SET  1 


EQUATION  2 

GBSERV 

AT  I  OHS 

NO. 

V 

Xc.  1) 

X  <  2 ) 

1 

7. 506 

2 , 800 

4 . 508 

2 

5.900 

1  ..  380 

4.15  0 

13.100 

1 . 000 

3 . 300 

*  .-1 

fcr 

14. 100 

0 . 900 

3.259 

tr 

.j 

19. 100 

8 . 788 

4. 458 

4.960 

1 . 900 

3 . 558 

NUMBER 

IS)  OF  THE 

I N  B  E  P  E  H  D  E  H  T  V  A  R I A  B  L  E  < S  > 

FITTED  =  i 

INITIO 

L  ESTIMATE 

S  OF  THETA 

THETA'-: 

1)  = 

1  0  0  0  0 8 0 0 0 0 0  0 

THETA! 

d  — 

- 1 . 0000080000 

FINAL 

ESTIMATES 

3F  THETA 

THETA t 

1)  = 

12. 1526090000 

THETFK 

2)  = 

-1 . 2609100000 

NO. 

V 

Y-HAT 

7.50000  5.07104 

5 . 9  0  0  0  0  8 .  7 2 9  s  5 

13.10000  12.15260 


4  14.10000  13.87920 

5  19.10000  19.05400 

6  4.96000  5.40985 


Data  Source: 

Headquarters  Armament  Development  and  Test  Center,  Cost  Analysis 
Division.  Air  Launched  Weapon  Systems  Cost  Model,  Volume  II  (U) . 
Eglin  Air  Force  Lase,  Fla.,  January  1974,  p.  5.  (Publication  SECRET.) 
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TOTAL  DEGREES, OF  FREE POM  =  5 
REGRESSION  DEGREES  OF  FREEDOM  =  2 
ERROR  DEGREES  OF  FREEDOM  =  3 


TOTAL  SUM  OF  SGUnRES  =  154.0723333 
REGRESSION  SUM  OF  SQUARES  =  139.0147671 
E R R 0 R  S U M  0 F  S C UARES  =  15.0575 6 6 7 3 
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DATA  SET  2 


EQUFlTIuH 


OB  SEN:  VAT I  OHS 

UO.  Y 

V 

<  1  >  X  <  2  > 

V  f 

!"!  !* 

1  43.380 

20 

, 000  1 1 , 00Q 

30  ■ 

000 

2  32.700 

224 

i 000  0.730 

48 . 

000 

3  28.500 

*7 

. 200  17.000 

3  6 « 

000 

4  93.700 

10 

. 200  29.960 

9  6 

000 

'5  164.200 

10 

»O00  88.209 

98 « 

0  i  1 0 

6  53.100 

82 

.000  3.600 

51 . 

000 

7  20.400 

60 

r  0 0  0  0 . 5  6  El 

30 . 

000 

8  26.500 

129 

.,000  0.550 

51 . 

000 

9  38.000 

170 

.000  9.450 

65 . 

000 

10  7.900 

3  3  2 

.000  0.010 

d  cl 

000 

NUMBER  (.  S )  OF  TI  E 

I  HD 

EPEHDEHT  VARIABLE 

3 

FIT 

INITIAL  ESTIMATES 

OF 

theta’ 

THETA C  1)  - 

.0 

. 2500000000 

THETA (  2)  = 

1 

. 0000000000 

TL|{7Tu  - 

1 

. 0000000000 

FINAL  ESTIMATES  C 

F  THETA 

1  H  E I  H  (  1 )  = 

3 . 566 1 606000 

THETA (  2>  = 

0 . 5100470000 

THETA 1  3 >  - 

0 . 5046260600 

NO.  Y  V-HAT 


1  , 

43. 3008O 

55.11 890 

2 

52 . 7  0000 

48. 08028 

3 

.  28. 50080 

40 . 77530 

4 

93 . ?  0000 

6  4 .  7  5  8  4  y 

5 

1 04 . 2  0O00 

1 1 0 . 65700 

6 

53. 10008 

55. 86360 

1 

20 ,  4  0000 

21. 48170 

8 

26 . 50800 

31 . 45430 

9 

38 . 09000 

32.72170 

10 

7. 99000 

1 1 .41530 

Data  Source: 

Brad  C .  Frederic.  Paranctric  Cos_t  Estimating  Relationships  for 
Missile  Preproduction  and  Product ion-Sunport  Elements.  Phase  I  Progress 
Report .  Tecolote  Research  Incorporated.  Santa  Barbara,  Calif., 

August  197A.  Table  7. 
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DATA  SET  3 


EQUATION 


OBSERVATIONS 

NO. 

Y 

II  .•  J  •. 

A  K  1  } 

1 

0.711 

250 . 000 

£ 

1.417 

1 000 . 000 

0.541 

152. 000 

4 

0.622 

143 . 000 

Cj 

0. 204 

25 . 800 

b 

0.495 

73 . 000 

»■" 

0.632 

69 . 000 

8.715 

250 . 000 

NUMBER 

<3>  OF  THE 

INDEPENDENT  VAR I ABLE (S 

ini  Tin 

L  ESTIMATE 

S  OF  THETA 

THETA < 

1>  = 

0 . 1  0 0 0 0 0 0 0  0 0 

THETA ( 

hi 

0 . 5  0  0  0  0 0 0  0 0 0  ‘  - 

FINAL 

r~  r-  t  r  m  r*. 

c. o  i  i  i  in 

t  r- 
1  C. 

S  OF  Tr 

-IET  A 

THETA < 

1>  = 

0, 

.  0724? 

030 

130 

THETA < 

'  2  ?  = 

0  , 

.42752 

20000 

NO. 

Y 

¥ 

-HAT 

i 

0. 

71 100 

0. 

76798 

o 

i. 

41709 

1. 

38914 

■2* 

0. 

541O0 

0. 

62081 

4 

0. 

62200 

0. 

60432 

5 

0  , 

20400 

0. 

2  8  6 9  6 

6 

0, 

49500 

0. 

45372 

r 

0. 

63200 

0. 

44292 

8 

0. 

71509 

0. 

7  6  7  9  8 

Data  Source: 

This  data  was  collected  from  several  sources.  The  regression  equation 
is  presented  in  the  following  document: 

Naval  Weapons  Center.  An  Independent  Cost  Analysis  of  the  HARM 
Weapon  System  RDT&E  (U)  ,  by  Douglas  R.  Johnson,  Dr.  Barbara  J.  Bell, 
Robert  E.  Sax,  Paul  A.  Douillard,  and  W.  Eugene  Waller.  China  Lake, 
Calif.,  NWC,  October  1975,  p.  38.  (Publication  CONFIDENTIAL.) 
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TOTAL  DEGREES  OF  FREEDOM  =  ? 

REGRESSION  DEGREES  Oc  FREEDOM  =  £ 

ERROR  DEGREES  OF  FREEDOM  =  5 

TOTAL  SOM  OF  SOU ARES  =  0. 829818875 

R E G R E S S 1 0 M  S U M  0 F  S Q  J A R E ::  =  0 .  771 985047 
ERROR  SUM  OF  SQUARES  =  0.057833828 

R E G R E  S 3 1 U f I  M E A f  •  S L"! U A  RE  =  0 . 3 S' 599252 3 
ERRUR  MEAN  SQUARE  =  0. 01 1566766 


F-RATIO  =  33.37032595 

0 0 EFFICIE N T.  0 F  DETER  "1 1  NAT  1 0 H  < R - S Q U fl R E )  =  0 . 9 3 0 3 6 ‘ 
S  1  ANI1  A R D  E R R 0 R  OF  T H  E  E S T I M ATE  =  0 .  10754 8 8 9 9 


~~i  ‘  r^iirf  iiiiiiMin‘  i  Hi'111  niri  r  m  - 


_ 
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DATA  SET  4 

EQUATION 
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OBSEt 

OVATIONS 

NO. 

V 

X<  1) 

1 

22340. 008 

74500 . 000 

iL 

1 5238 . 000 

74600 „ 000 

-* 

1 2390. 000 

5*9875 . 000 

4 

4142.000 

6540 , 000 

5 

1516. 000 

4063 , 000 

b 

1321 . 000 

3694 . 000 

T 

15936. 000 

97 120. 000 

8 

17975.000 

97120 . 000 

9 

5 1 88 . 008 

21300 . 000 

10 

3219. 000 

1 4 1 00  „  000 

1  1 

5567 . 000 

23370 ; 000 

1 2 

5188 . 000 

21300 . 000 

13 

3523. 000 

1 9820 . 000 

14 

127. 000 

129 . 000 

1 5 

621 . 000 

1 170. 000 

16 

700 . 000 

1 947 . 000 

17 

2739. 008 

23590 , 000 

j.  C* 

Si . 0bb 

54 1 5o . 800 

19 

5842 . 0O0 

51200 , 000 

20 

3010. 000 

6060 . 000 

21 

2367 . 006 

7050 , 000 

«£.’ 

8543.006 

5830O . 000 

lifri 

7056 . 000 

'?973  a  O00 

O  +'■ 
i-  *-r 

90 1 9 . 000 

6 1 800 , 800 

25 

4656. 000 

2 l 648 . 000 

26 

4803. 000 

1 9760  a  O00 

o 

C.  1 

2233. 000 

1 3468 . 800 

NUMBER <S>  OF  TEE  INDEPENDENT  VARIABLE (S)  FITTED  =  1 


INITIAL  ESTIMATES 
THETA (  i>  = 

T  H  E  f  H 2 )  “ 


OF  THETA- 
2 . 00000000O0 
1 . 0000000000 


FINAL.  EOT I MAT 

'EE  0 

T-  THETA 

THETA (  1>  * 

1 . 5891500000 

THETA <  2>  * 

0 . 8049880000 

Data  Source: 

Naval  Weapons  Center.  Solid.  Motor  Cost  and  Reliability  Prediction 
Methodology,  Final  Technical  Report  (U) ,  by  Eooz-Allen  Applied 
Research.  China  Lake,  Calif.,  NWC,  March  197A.  Tables  5  and  6. 

(NWC  TP  563A,  Publication  CONFIDENTIAL.) 


<cf\ 
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HO. 

V 

Y-HAT 

1 

22840 .  i  0000 

1 4  115. 40880 

£ 

15238. 00006  • 

14138. 70080 

12390. 00000 

1 1838. 4O080 

4 

4142. 0000O 

1991 . 41000 

C‘ 

1516. 001000 

1357. 52800 

6 

1321 , 0  01000 

1257. 36000 

r* 

15936. 00U00 

17473, 900R0 

8 

1 7975 . 0 0000 

17473. 98000 

9 

5138. 00O00 

5151 , 83800 

10 

32 1 9 . 0  0008 

3696 . 86808 

1  1 

5567 . 00008 

555 i . 1 8800 

12 

5 1 88 . 0  0800 

5151 . 83G0O 

13 

8523 . 0  010001 

4  8 61.6  6  0 0 0 

14 

1 27 . 0  0000 

84. 46328 

15 

621.0  0000 

498 . 33488 

1 6 

700 . 00800 

750.87600 

1 7 

2739. 00000 

5593 . 2 1 800 

18 

9296. 00900 

10918. 38080 

19 

5842. 00080 

10436. 9G000 

26 

3010. £0000 

1872.89000 

21 

236 7 . 1 0y0y 

2115.50800 

c‘2 

8543.60000 

1  1587. 06600 

23 

7056.0:0008 

2335. 75000 

24  ■ 

9019. 00900 

12143. 80000 

2*5 

4656 . 00000 

5219. 48006 

26 

4803 . £0600 

4849. 81000 

27 

2233 . 60088 

3562. 1 1800 

_ i 

i — 

i _ ;< 

t- 

-  G  R  E  E  S  0  F  F  R  t.  ] 

iijM  =  26 

REGRESS 

ION  DEGREES  06 

FREEDOM  =  2 

ERROR  D 

EGREE3  OF  FREE! 

JOM  =24 

TOTAL.  S 

IJM  OF  SC  HARES 

=  870169 

REGRESS 

I  Or  i  SUM  OF  SO  Of 

IRES  =  694949 

ERROR  3 

IJM  OF  SC  U ARES 

=  175219 

REGRESS [OH  MEAF  SQUARE  =  347474981.3 
ERR  UR  MEAN  SQUARE  7300826. 045 

F  - R ATI 0  =  47. 5 S 3 9 £ 6 9 2 


COLE!-  iCIEHT  OF  DETER  4 1  HAT  I  ON  <R -SQUARE 
STANDARD  ERROR  OF  THE  ESTIMATE  *  2702. 
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